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stream 
input 





Jag Value Pair 206 

Type -[Utterance-Word] 



Elements 
Time code 
Start [00:12:14:02:23:18:59] 
Duration (seconds) [.086] 
.Word 
[Today] 

U.S. English confidence factor: 
[-55] 

European Spanish confidence factor: 
[.22] 

Relevant Time Window 
[Begin to End] 

Hyperlink to relevant URL(s) 
[www. . . .] 
Saliency to link 
[.46] 202 



208 



Tag Value Pair 

Type -[Image-Scene Change] 



Elements 
Time code 
Start [00:12:14:02:23:18:59] 
Duration (seconds) [12.437] 
Title 

[Airport Setting] 
JPEG code 

[code or link to image codes] 
. Relevant Time Window 

[Begin to End] 
„ Hyperlink to relevant URL(s) 
[www. . . .] 
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Transcript corresponding 
with the time codes of the 
video segment 
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Transcript 
corresponding with the 
time codes of the video 

segment 
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Figure 3 
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Identify attributes from an information stream; 
402 
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Encode each of the identified attributes from the information stream- 

404 



Assign a time ordered indication with each of the identified attributes wherein 
each of the identified attributes share a common time reference measurement 
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Generate a time ordered index of the identified attributes 

408 



Correlate a first identified 
attribute of the information 
stream with a second identified 
attribute having a similar time 
code. 
410 
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Trigger links and 
synchronize the appearance of 
the links in real time 
416 



Generate a query on the 
one or more of the identified 
attributes in the time ordered 
indexed . 
412 




Transmodally manipulate 
a first type of attribute by 
performing an operation on a 
second type of attribute. 
418 



Figure 4 
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